Graph Pointer Neural Networks

نویسندگان

چکیده

Graph Neural Networks (GNNs) have shown advantages in various graph-based applications. Most existing GNNs assume strong homophily of graph structure and apply permutation-invariant local aggregation neighbors to learn a representation for each node. However, they fail generalize heterophilic graphs, where most neighboring nodes different labels or features, the relevant are distant. Few recent studies attempt address this problem by combining multiple hops hidden representations central (i.e., multi-hop-based approaches) sorting based on attention scores ranking-based approaches). As result, these approaches some apparent limitations. On one hand, do not explicitly distinguish from large number multi-hop neighborhoods, leading severe over-smoothing problem. other models joint-optimize node ranking with end tasks result sub-optimal solutions. In work, we present Pointer (GPNN) tackle challenges mentioned above. We leverage pointer network select amount which constructs an ordered sequence according relationship 1D convolution is then applied extract high-level features sequence. The pointer-network-based ranker GPNN joint-optimized parts end-to-end manner. Extensive experiments conducted six public classification datasets graphs. results show that significantly improves performance state-of-the-art methods. addition, analyses also reveal privilege proposed filtering out irrelevant reducing over-smoothing.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Graph transformation and pointer structures

This thesis is concerned with the use of graph-transformation rules to specify and manipulate pointer structures. In it, we show that graph transformation can form the basis of a practical and well-formalised approach to specifying pointer properties. We also show that graph transformation rules can be used as an efficient mechanism for checking the properties of graphs. We make context-sensiti...

متن کامل

Pointer Networks

We introduce a new neural architecture to learn the conditional probability of an output sequence with elements that are discrete tokens corresponding to positions in an input sequence. Such problems cannot be trivially addressed by existent approaches such as sequence-to-sequence [1] and Neural Turing Machines [2], because the number of target classes in each step of the output depends on the ...

متن کامل

Code Completion with Neural Attention and Pointer Networks

Intelligent code completion has become an essential tool to accelerate modern software development. To facilitate effective code completion for dynamically-typed programming languages, we apply neural language models by learning from large codebases, and investigate the effectiveness of attention mechanism on the code completion task. However, standard neural language models even with attention...

متن کامل

Kernel Graph Convolutional Neural Networks

Graph kernels have been successfully applied to many graph classification problems. Typically, a kernel is first designed, and then an SVM classifier is trained based on the features defined implicitly by this kernel. This two-stage approach decouples data representation from learning, which is suboptimal. On the other hand, Convolutional Neural Networks (CNNs) have the capability to learn thei...

متن کامل

Gated Graph Sequence Neural Networks

Graph-structured data appears frequently in domains including chemistry, natural language semantics, social networks, and knowledge bases. In this work, we study feature learning techniques for graph-structured inputs. Our starting point is previous work on Graph Neural Networks (Scarselli et al., 2009), which we modify to use gated recurrent units and modern optimization techniques and then ex...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2022

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v36i8.20864